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Abstract — THIS PAPER IS ELIGIBLE FOR THE STUDENT 
PAPER AWARD 

Binary 0-1 measurement matrices, especially those from coding 
theory, were introduced to compressed sensing (CS) recently. 
Good measurement matrices with preferred properties, e.g., the 
restricted isometry property (RIP) and nullspace property (NSP), 
have no known general ways to be efficiently checked. Khajehne- 
jad et al. made use of girth to certify the good performances of 
sparse binary measurement matrices. In this paper, we examine 
the performance of binary measurement matrices with uniform 
column weight and arbitrary girth under basis pursuit. Explicit 
sufficient conditions of exact reconstruction are obtained, which 
improve the previous results derived from RIP for any girth g 
and results from NSP when g/2 is odd. Moreover, we derive 
explicit h/h, h/h and lao/h sparse approximation guarantees. 
These results further show that large girth has positive impacts 
on the performance of binary measurement matrices under basis 
pursuit, and the binary parity-check matrices of good LDPC 
codes are important candidates of measurement matrices. 

I. Introduction 

Consider a k-sparse signal x — (x\, X2, ■ ■ ■ , x n ) T € K" 
which has at most fc nonzero entries. Let H E l raXn be 
a measurement matrix with m <C n and y — Hx be the 
TO-dimensional measurement vector. The compressed sensing 
(CS) problem (T), El aims to solving the following l - 
optimization problem 



s.t. Hx 



(1) 



where ||jc||o — \{i '■ %i 7^ 0}| denotes the ^o-norm or 
(Hamming) weight of x. Unfortunately, it is well-known that 
the problem dT) is NP-hard in general. In CS, a convex 
relaxation of (mi, the h-optimization (basis pursuit), is usually 
used instead, 



s.t. Hx 



(2) 



where = Y27=i \ x i\ denotes the Zi-norm of x. The 

optimization problem Q could be turned into a linear pro- 
gramming (LP) problem and thus tractable. 

In order to recover the original signals exactly, measurement 
matrices need to satisfy some properties. Candes and Tao [3| 
showed that if H satisfies the restricted isometry property 
(RIP) with relatively small restricted isometry constant 62k, 
li -optimization |2]i can output exact recovery of any fc-sparse 
signal. In addition, when the signal x is not exactly sparse, Q 
is supposed to produce a high quality k-sparse approximation 
of x as good as one measures the k largest values of x 
directly. RIP is only sufficient, another property, called the 
nullspace property (NSP) (4), was proposed and proved to 
be both sufficient and necessary for a measurement matrix 
to be effective under basis pursuit. If H satisfies NSP, l\- 
optimization Q will produce exact recovery of sparse signals 



and high quality sparse approximations of other signals. Many 
random matrices, e.g., Fourier matrices, Gaussian matrices, 
etc., were verified to satisfy RIP with overwhelming probabil- 
ity. However, there is no guarantee that a specific realization 
of random matrices works and it costs large storage space. As 
a result, deterministic constructions of measurement matrices 
are necessary. Among them, binary 0-1 matrices from coding 
theory attract many attentions 0, |6|. Recently, Dimakis, 
Smarandache, and Vontobel [7| found that LP decoding of 
LDPC codes is very similar to LP reconstruction of CS, 
and they further showed that the sparse binary parity-check 
matrices of good LDPC codes can be used as provably good 
measurement matrices under basis pursuit. 



For a binary matrix H, let Gh denote its Tanner graph 
which was introduced to study LDPC codes [8|. The girth 
of H or Gr is defined as the minimum length of circles 
in Gh- Note that girth is an even number not smaller than 
4. Deterministic matrices with RIP or NSP have no general 
ways to be definitely constructed or efficiently verified [9|. 
Instead, in J7), (9), girth is used to evaluate the performance of 
sparse binary measurement matrices under basis pursuit. It was 
shown that binary measurement matrices with girth Sl(logn), 
uniform row weights and uniform column weights have robust 
recovery guarantees under basis pursuit with high probability. 
Since girth is much easier to check, it is considered as a good 
property to certify good binary measurement matrices. 



In this paper, we examine the performance of binary mea- 
surement matrices with uniform column weight 7 and arbitrary 
girth g under basis pursuit. This kind of matrices are often used 
as measurement matrices, such as those based on expander 
graphs ifTOl where binary matrices with uniform column 
weight are associated with left-regular bipartite graphs. Let 
H be such a matrix and A be the maximum inner product of 
two different columns. One of our main results implies that H 
could exactly recover a fc-sparse signal if k < 2~^L=o(7 — 1)™> 
where t = > 0. When g = 6, the best known result 

derived from RIP [11 Prop.l] or NSP Q Lem.12, Th.3] 
implies the exact recovery for k < (7 + l)/2, while our 
result only requires k < 7. In fact, we derive explicit fc-sparse 
approximation guarantees which involve only k, g, 7, A when 
g = 4 and fc, g, 7 when g > 6 respectively. Our results 
show that the larger g or/and 7 are, the larger k will be, thus 
the better H is. This suggests that good parity-check matrices 
for LDPC codes are important candidates of measurement 
matrices. 



II. Notations and Preliminaries 
Let H G R mx " with m < n, define [n] = {1, . . . , n} and 

Nullsp«(H) = {we R n : Hw = 0}, 
Nullsp^(H) = Nullsp R {H)\{0}. 

Let K C [n], \K\ = fc, define K = [n]\K. For any real vector 
a = (ai, a,2, ■ ■ ■ , a n ) T <E R n , an denotes the vector with fc 
entries of a whose positions appear in K. Define the I2 and 
loo norms of a as ||a|| 2 = a i and I l«l loo — max; |aj|. 

The support of a is defined by supp(a) — {i : ai 7^ 0} 

, the 
and 



and denotes \a\ = (\di\, |a 2 |, . 



For a ^ e 



AWGN channel pseudoweight of a is w£ WGN (a) = ||^ 

the max-fractional pseudoweight is w max _f rac (a) = rWp . 

Firstly, the l p /l q sparse approximation guarantees are used 
here as performance metrics for CS under basis pursuit. 

Definition 1: Q An l p /l q sparse approximation guarantee 
for basis pursuit means that the ^-optimization ([2]) outputs an 
estimate x such that 



\x X\\p 5: Cp^q(k) ■ \ \x 



9< 



(3) 



where 



7 ) denotes the L (L) norm, and x' is the 



best fc-sparse approximation of x. 

Next, we introduce the well-known NSP. 

Definition 2: H, Let H € R mxn , k G N, and C > 
1. We say that has the nullspace property NSP^ (k, C) 
denoted by i? G NSP^(k, C), if Vif C [n] with \K\ < k 

C • < |k^||i, Vw G Nulls PR (H). 

In Q, Dimakis, Smarandache, and Vontobel pointed out that 
the LP reconstruction of CS is very similar to the LP decoding 
of LDPC codes. Performance guarantees in LDPC codes 
were translated to the corresponding sparse approximation 
guarantees in CS, e.g., the next result gives the connection 
between AWGN channel pseudoweight and I2/I1 guarantee. 

Proposition 1: [7 Th. 13] Let H be a binary m x n measure- 
ment matrix, K C [n], \K\ = fc, C be an arbitrary positive 
real number such that C > 4k. If Vw G Nullsp^(H) 

w^ WGN (\w\) > C, (4) 

then the output x produced by the ^-optimization |2]) satisfies 

1 



C" 

■*|| a <^ll* 



K\\l 



with C" ± 



(5) 



1 



III. Main Results 

We start this section by giving a sufficient condition for 
a binary measurement matrix to provide the h/h and 

loo/h sparse approximation guarantees for l\ -optimization. 

Theorem 1: Let H be a binary m x n measurement matrix 
such that Vw = (iui, W2, ■ ■ ■ , w n ) T G Nullsp^(H) and Mi G 

" Wl1 (6) 



\Wi\ < 



Co 



then for any set K C [n] with |7f | = k < the estimate x 
produced by the l\ -optimization |2]) will satisfy: 

1) 

Co 



* 1 < -r-ll* 
fc 



Kill 



with Ci = 



£Zll 
2 A' 



(7) 



2) 



3) 



* 2 



< 



C 2 



Kin 



with Co = 



with C3 



Co 
2 A' 



2k 



(8) 



(9) 



Proof: Since if* = 31 and —y, define w = x x, then 
w G NullspuiH). If w = 0, Q, (|8]l and (|9]l holds obviously, 
so we only need to consider the case w G Nullsp^(H). 

1) (jSJl implies Vw G Nullsp^(H), < ^l|w||i, or 
H G A^5P]| (fc, C) with C = ^ - 1. Hence, (^| follows 
directly by the nullspace condition [4, Th. 1], [7, Th.5]. 

2) Applying (|6|l to [12, Lemma 1], we have 



U AWGN { 



H) = 



>Cn 



(10) 



which implies ||jc— Jcj ] 2 < i||i/-\/Co and ([8J1 follows 

by 0- 

3) (|6| implies w max _f rac (\w\) > C - Hence, (|9| follows 
directly by Th.14]. 

■ 

Remark 1: From or (|9j, it is easy to see that if 

H satisfies (jHJl, for any fc-sparse signal x with fc < ^P-, 
^-optimization (|2]i outputs exact recovery of x. Even when 
x is not exactly sparse, Q still produces a good fc-sparse 
approximation that is within only a factor from the best fc- 
term approximation of x, where fc is smaller than 



Co 



Remark 2: Since (lOi can be implied by (|6]), Proposition 
[T] gives that the ^-optimization Q outputs exact recovery of 
fc-sparse signals with fc < which is only a half of fc < ^ 
that our result indicates. Besides, when Co > 4fc one can easily 
verify that ^ < £L by letting C — Co, which means our 
approximation guarantee is sharper than that of Proposition [T] 

The following two theorems which evaluate Co in ([6]) are 
the key results of this paper. One is for binary matrices with 
girth 4 and the other for girth greater than 4. 

Theorem 2: Let If be a binary m x n measurement matrix 
with uniform column weight 7 and girth <?. Suppose the 
maximum inner product of any two distinct columns of H 



is A. Then for any w 

and any i G supp(w), 

H < 



(w 1 ,w 2 , ■ ■ ■ ,w n ) r G Nullsp^(H) 



Co 



with Cq 



A 27 
A ' 



(11) 



Proof: Firstly, we claim that for any binary matrix H with 



uniform column weight 7 and any w 

Nullsp^(H), we have 



2 w j 

j : Wj>0 



J2 w j 

j : Wj<0 



(12) 



This is because by summing all rows of H, we obtain a new 



12) 



row h = (7, 7, ... , 7), and hw = implies 

For any w £ Nullsp^(H), we split its support supp{w) 
into supp{w + ) and supp(w~), where 



supp(w + ) 
supp(w~) 



{i 



w l > }, 
w t < }. 



For any fixed i G supp(w + ), by summing the 7 rows of H 
each of which has component ' 1 ' in the i-th position, we obtain 
a new row h(i) — (hi(i), fi2(i), ■ ■ ■ , h n (i)) where hi(i) = 
7 and for any j 7^ i, < hj(i) < A, since the maximum 
inner product of any two distinct columns of H is A. Clearly, 
h(i)w = 0, i.e., 

E 

j£supp(w~ ) 







E 

j£supp(w + ) 



h 3 (i)w 3 



which implies that 

hj(i)Wj 



E 



j£supp(w ) 



E 

j£supp(w Jr ) 



(a) 

J > IWi, (13) 



where (a) follows by i G supp(w + ), hi(i) = 7 and the other 
items in the summation are non-negative. On the other hand, 
since < hj(i) < A for any j G supp(w~), 



E 



hj(i)wj < —A 



E 



(«0 J 
w,; = A- 



(14) 



j^suppiw ) 



j£supp(w 



where (b) follows by ( 12 1. Combining ( 13 1 with ( 14 1, we have 

AjHU 



that for any Wi > 0, Wi < 



21 



Similarly, for any Wi < 0, we have that 



-JWi 



< 



E 

j £supp(w 



hj(i)w 



1 E 



hj(i)wj < A 



Mil 
2 



< ^IMij , and this completes the proof. 



or — Wi 

Remark 3: Combining Theorem [2] with Theorem[T[ we have 
that the l\ -optimization Q can exactly reconstruct any k- 
sparse signal with k < j when the binary measurement matrix 
H with uniform column weight 7 is used. According to the 
best known result based on RIP [11, Prop.l], H satisfies the 
RIP of order ,s < 1+ ? and the ^-optimization (pi can exactly 
reconstruct /c-sparse signals with k < (1 + jJ/2. Thus, our 
result of Theorem [2] improves it significantly in most cases. 

Example 1: Let g = 4, 7 = 4, A — 2, and i7 be the point- 
plane incidence matrix of a 3 -dimensional Euclidean geometry 
over {0, 1} (see |[T? i| for details), i.e., 



H 



( 1 
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1 








1 


1 











1 \ 





1 








1 


1 


1 


1 





1 


1 











1 





1 
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1 





1 
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1 








1 


1 





1 








1 








1 





1 


1 





1 


1 


1 





1 

















1 





1 


1 





1 


1 


1 





1 





1 











1 





1 








1 


1 


1 





1 


1 


1 











1 





V 




















1 


1 


1 


1 


1 


1 


1 / 



(1,-1,0,0,0,0,0,1 

G supp(w), \wi\ = 



-1,0,0,0,0,0) T G 



iv 1 1 1/4. Note that 
is achieved. 
1 and thus \wA < 



It is easy to see w 
Nullsp^H) and Vi 

1 + 7/A = 3, 27/A = 4 and the bound ([TT 

For a binary matrix with g > 6, A = 1 anc „ .,. 
by Theorem [2j which is independent of g. The next theorem 
applies to g > 4 and gives better results for g > 8. 

Theorem 3: Let H be a binary mxn measurement matrix 
with uniform column weight 7 > 2 and girth g > 6. Then for 
any w G Nullsp^(H) and any i G supp(w), 

t+i 



Kl < 



(9>6) 



a 



with C^- 6) ^2^( 7 -l)", (15) 



where t = L^j^J an d l x \ is the floor function which denotes 
the maximum integer not greater than x. 

Proof: Clearly, g = At + 6 for odd g/2 and g = it + 8 
for even g/2. Let Gh be the Tanner graph of H with m 
check nodes and n variable nodes. For any variable node i G 
supp(w), we construct a local tree of i (see Fig. [TJ as in the 
proof of H2 Th. 3. lid Th. 1]. 

In the local tree of i, i is the root of the tree. A check node 
/ connected to i is called a child of i, and a variable node j 
connected to / except its parent i is called a child of / or a 
grandchild of i, and a check node e connected to j except its 
parent / is called a child of j, and so on. For a variable node 
j in the local tree, let child(j) and grch(j) denote the sets 
of all children and grandchildren of j respectively. Note that 

grch(j) = U/ 6 chUd(j) child (/)- A11 nodes in L o(i) = grch(i) 
are Level-Q variable nodes. For u = 1, 2, . . . , t, all nodes in 



L u(i) = (J grch(j) 
jei«-i(i) 



(16) 



are Level-u variable nodes. Fixing a check node /* G child(i), 
denote N (f*) = child (/*) and 



Nu(n = U g rch 0')> 



1,2,.. 



,t + l. (17) 



The local tree of i has levels through t if g — At + 6 and 
through t + 1 if g = At + 8, where N t +i(f*) is the set of 
(t + l)-th level nodes. Since the Tanner graph Gh has girth 
g > 6, it is clear that if g = At + 6, {i}, L (i), . . . , L t (i) 
are pairwise disjoint and if g = At + 8, {i}, Lo(i), . . . , L t (i), 
Nt+i(f*) are pairwise disjoint. 

Since there are 7 l's in every column of H, we have 
that |child(i)| = 7 and | child =7—1 for any in- 
termediate variable node j. Since w G Nullsp^(H) sat- 
isfies every check equation in child(i), we have 71^ + 



E 

(7-l)^- + £,, 



by adding these equations. Similarly, 
= for any intermediate variable 



j'egrch(j) 



node j. Thus, by using the above two equalities iteratively, we 
have that 



Wi 



7(7 - l)Wi 
7(7 - l) 2 w l 



(-l)°-w h (18) 

(-i) 2 - Yl w ^ ( 2 °) 

(-1) 3 ' E w i> W 



7(7 - 1)' 1 w l 
7(7 - l) t w l 



(I 



«=0 



(-1)*- ^ w h (22) 

(23) 

iei«(i) 

and when g = At + 8, we additionally have 

(7-l)* + V = (-l) t+2 - ^ (24) 

The following proofs are divided into 4 cases according to 
the parities of g/2 and t. 

Case 1: g/2 is odd, t is odd. 



variable node i 

7 



check node/ 



variable node / 




Fig. 1. Local tree of variable node i 



If Wi > 0, by summing all equations having even power of 



(-1) on the right, or ( 18 1, (20 1, . . . , and (23 i, we have 



(t-l)/2 

1+ E 7(7-l) 2s+1 



s=0 
(t-l)/2 

™i+ E E 



s =0 jeL 2a+ i(i) 
(t-l)/2 

< ™i+ E E W J 

t 

< ^ + E E w j 



(«) 
< 



E W 3 

j : Wj >a 



«=0 jeL u {i), Wj>0 

w IMIi 



(25) 



where (a) holds because {z}, £o(i), . . . , L t (i) are pairwise 
disjoint, and (b) follows by l jl2[ i. 
If u>i < 0, we have 

(t-l)/2 

1+ E 7(7-l) 2s+1 

s=0 
(t-l)/2 

= w >+ E E w j 

s=o jei 3s+ i(») 

(t-l)/2 _^ 

^ w >+ E E w j 

IMIi 



> 



E 



(26) 



j : wj<0 

Therefore, combining ( |25] l with ( |26| , we have that 

IHU 



\Wi\ < 



(<0 



l + Et"o 1)/2 7(7-l) 2s+1 

IMIi 



2Ett 1 (7-l)" : 



where (c) follows from 7(7 — 1)" = (7 — l) v + (7 — 1) 



(27) 



v + l 



By summing all equations having odd power of (—1) on the 



right, or ( 19 1, (21 1, . . . , and (22i, we could similarly obtain 



Kl < 



Hi 



2£i=o 1)/2 7(7-i) 2s 
But it is weaker than d27l since 



(28) 



1 



(t-l)/2 

E 

s=0 



7(7- 1) 



2s+l 



> 



(t-l)/2 

E 

s=0 



7(7 "I)' 



Case 2: g/2 is odd, t is even. 

With totally similar arguments, we have 



w,\ < 



IMU 

,4 / 2 _ 1 \2s-l 



l + E t /=i7(7-l) 2 



and 



H < 



w 1 



2Et 2 o7(7-l) 



(29) 



(30) 



Since 



E 

u=0 



(7- 



t/2 t/2 

ir = E7(7-i) 2s >i + v 7 (7-i) 2 



s=0 



s=l 



we also have 



H < 



2ELto(7-l)"' 



(31) 



Case 3: g/2 is even, t is odd. 

This case is different from Case 1 in that while summing 
the equations with odd power of (—1) on the right, an extra 
(24 1 needs to be summed. By summing (19 1, (21 1, (f2"2")> 



and (24 1, we could similarly obtain 



Wi < 



Mi 



Ei=o 1)/2 7(7-l) 2s + (7-l) t+1 

IMIi 



(32) 



2Et=o(7-lK 
Note that the two summing methods give identical results. 

Case 4: g/2 is even, t is even. 

This case is different from Case 2 in that while summing 
the equations having even power of (—1) on the right, an extra 
(24 1 needs to be summed. By summing (I81, (20i, ( |22] > 
and ( |2"4"| i, we could similarly obtain 

IMIi 



kl < 



l + E t /= 2 i7(7-l) 2s - 1 + (7-l) t+1 

Hli 



(33) 



2E t tl t 1 o(7-l)"' 
Note that the two summing methods give identical results. 
Combining ( 27 1 with (|3T|-(|33]l, the proof is completed. ■ 
Remark 4: Combining Theorem [3] with Theorem [T] we 
have that the ^-optimization d2]» can exactly reconstruct any 
/c-sparse signal with k < E«=o (7 — -0" when the binary 
measurement matrix H with uniform column weight 7 > 2 
and girth g > 6 is used. Kelley and Sridhara |fT3l showed that 

... BSC, rain l tj\ 

w p [H) 

, 2E*to(7 - 1)" - (7 - l) t+ \ 5/2 is odd, 
2E*to(7-ir, 5/2 is even/ } 



By the result based on NSP [7 Lem.12, Th.3], the l x - 
optimization Q can exactly reconstruct fc-sparse signals with 



k < 



l) 1 



(7-1)* 



g/2 is odd, 
g/2 is even. 



(35) 



. E«to(7- 

Thus, our result of Theorem [5] improves it when g/2 is odd. 

The following examples show that the bound in ( fl~5| ) could 
be achieved for g = 6, 8, 10, 12 respectively. 

Example 2: Let g = 6, 7 = 2, and H be the point-line 
incidence matrix of a Euclidean plane over {0, 1} fl5l . i.e., 



H 



( 1 
1 


V 




1 

1 / 



Let w = (1,0,-1,0,-1,1) T G Nullsp^(H), Vi G supp(w), 
\vii\ = ||w||i/4, which meets the bound ( fl5| ). 
Example 3: Let g — 8, 7 = 2, and _ff be the point-line 



H = 



:e matrix of a cube (see [ 


131 for details), 


i.e., 


f 1 








1 














1 
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1 























1 
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1 
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1 
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1 








1 
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1 
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1 














1 





V 














1 


1 


1 











J 



-1,0,0,0,0,0,0,0,0) T G Nullsp^(H), 



Let w = (1, -1, 1, 
Vi G supp(w), \wi\ 

Example 4: Consider the point-line incidence matrix H of 
GP(5,2) El, g = 10, 7 = 2, 



|w||i/4, which meets the bound (15 1 



H-- 



(I 
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1 
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1 
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1 
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1 
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1 
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1 
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1 
































1 

















1 


1 


v° 

















1 














1 


1 








Let w = (-1, 1, 0, 0, 1, 0, -1, 0,-1, 0, 0, 1, 0, 0, 0) T , it is easy 
to check that w G Nullsp^(H) and Vi G supp(w), \uii\ = 



|w||i/6, which meets the bound (15 1 



Example 5: Consider the following H with g = 12, 7 = 2, 



H 



( 1 
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1 
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1 
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1 




















1 























1 














1 





V 























1 








1 



Let w = (1,0,-1,-1,0,1,0,0,0, 1,-1, 0) T G NullspUJI), 
Vi G supp(w), \u>i\ = ||w||i/6, which meets the bound (15 1. 



IV. Conclusion 

This paper has considered the performance of binary mea- 
surement matrices with uniform column weight under basis 
pursuit. Girth of such matrices is employed to provide 
h/h and loo/h sparse approximation guarantees for l\- 
optimizations, which improve previous known RIP results for 
any girth and NSP results for girth 4 and At + 6. Moreover, 
our formulae of approximation guarantees are simple and 
clear, and the corresponding bounds are shown to be tight 
by examples for girth not greater than 12. Our results show 
that the larger the girth and/or column weight is, the better 
the binary measurement matrix will be, which further shows 
that large girth has positive impacts on the performance of 
binary measurement matrices. Our results and methods have 
close relations with that in LDPC codes, which suggests that 
the parity-check matrices of good LDPC codes are important 
candidates of measurement matrices. 

For fixed matrix size m and n, large Co in Theorem [T] 
is preferred. There might be a maximum Co for matrices 
with given size m, n. Future works may include finding the 
maximum Co and better approximate guarantees. 
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